Technology Focus: Data Acquisition 



C rew Activity Analyzer 

Video, audio, and position data are recorded and analyzed. 

Ames Research Center, Moffat Field, California 


The crew activity analyzer (CAA) is a 
system of electronic hardware and soft- 
ware for automatically identifying pat- 
terns of group activity among crew 
members working together in an office, 
cockpit, workshop, laboratory, or other 
enclosed space. The CAA synchronously 
records multiple streams of data from 
digital video cameras, wireless micro- 
phones, and position sensors, then plays 
back and processes the data to identify 
activity patterns specified by human an- 
alysts. The processing greatly reduces 
the amount of time that the analysts 
must spend in examining large amounts 
of data, enabling the analysts to concen- 
trate on subsets of data that represent 
activities of interest. The CAA has po- 
tential for use in a variety of governmen- 
tal and commercial applications, includ- 
ing planning for crews for future long 
space flights, designing facilities 


wherein humans must work in proxim- 
ity for long times, improving crew train- 
ing and measuring crew performance in 
military settings, human-factors and 
safety assessment, development of team 
procedures, and behavioral and ethno- 
graphic research. 

The data-acquisition hardware of the 
CAA (see figure) includes two video cam- 
eras: an overhead one aimed upward at a 
paraboloidal mirror on the ceiling and 
one mounted on a wall aimed in a down- 
ward slant toward the crew area. As many 
as four wireless microphones can be 
worn by crew members. The audio sig- 
nals received from the microphones are 
digitized, then compressed in prepara- 
tion for storage. Approximate locations 
of as many as four crew members are 
measured by use of a Cricket indoor loca- 
tion system. [The Cricket indoor loca- 
tion system includes ultrasonic/ radio 


beacon and listener units. A Cricket bea- 
con (in this case, worn by a crew mem- 
ber) simultaneously transmits a pulse of 
ultrasound and a radio signal that con- 
tains identifying information. Each 
Cricket listener unit measures the differ- 
ence between the times of reception of 
the ultrasound and radio signalsfrom an 
identified beacon. Assuming essentially 
instantaneous propagation of the radio 
signal, the distance between that beacon 
and the listener unit is estimated from 
this time difference and the speed of 
sound in air.] In this system, six Cricket 
listener units are mounted in various po- 
sitions on the ceiling, and as many as 
four Cricket beacons are attached to 
crew members. The three-dimensional 
position of each Cricket beacon can be 
estimated from the time-difference read- 
ings of that beacon from at least three 
Cricket listener units. 



Activities of Crew Members Are Monitored by use of video cameras, microphones, and Cricket beacon and listener units. Monitor data are recorded, then 
played back and analyzed to identify patterns of group activity. 
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The CAA includes a notebook com- 
puter that controls the rest of the system 
and can be used to process the data 
upon playback. The CAA software in- 
cludes components that separately cap- 
ture the video, audio, and position data 
streams and store them in files on the 
hard drive of this computer. Alterna- 
tively or in addition, the data can be 
stored on one or more external hard 
drive(s) or on a digital videodisk. Data 
can be played back from any of these 
storage media. The CAA can store data 
for an observation interval as long as 
two weeks. 

In addition to the video image data, 
the video-data-storage software compo- 
nent records the times of individual 
frames from each camera, enabling syn- 


chronization of the video data with the 
audio and position data during play- 
back and analysis. The position-data- 
storage software component reads data 
from the six Cricket listener units, cal- 
culates the three-dimensional positions 
of the Cricket beacons according to the 
principle described above, and saves 
these positions in a text file. The posi- 
tion -data-sto rage software component 
also creates, reads, and writes a Cricket 
calibration-data file. 

The CAA software further includes 
components for playback and analysis of 
the recorded data. One of these software 
components provides capabilities for 
searching and playback using the video, 
audio, and position data files as well as 
files that describe rectangular areas of 


interest (AO Is) on the floor as defined 
by the user with the help of another soft- 
ware component. Several other compo- 
nents perform a variety of analyses of 
image data. Still another software com- 
ponent reads the position and AO I data 
files and generates reports on activities 
of interest represented in the data (e.g., 
it generates histograms of occupation of 
AO Is by crew members). The data in the 
reports can be saved in a format suitable 
for export to a spreadsheet program. 

This work was done by James M urray and 
Alexander Kirillov of Foster-Miller, Inc. for 
Ames Research Center. Inquiries concerning 
rights for the commercial use of this in ven tion 
should be addressed to Judith Gertler, Divi- 
sion Manager, Foster-Miller Inc. at (781) 
684-4270. Refer to ARC-15162-1. 


« Distributing Data to Hand-Held Devices in a Wireless Network 

Lyndon B. Johnson Space Center, Houston, Texas 


ADROIT is a developmental com- 
puter program for real-time distribu- 
tion of complex data streamsfor display 
on Web-enabled, portable terminals 
held by members of an operational 
team of a spacecraft-command-and-con- 
trol center who may be located away 
from the center. Examples of such ter- 
minals include personal data assistants, 
laptop computers, and cellular tele- 
phones. ADROIT would make it unnec- 
essary to equip each terminal with plat- 
form-specific software for access to the 
data streams or with software that im- 
plements the information-sharing pro- 
tocol used to deliver telemetry data to 
clients in the center. 


ADROIT is a combination of middle- 
ware plus software specific to the center. 
(Middleware enables one application 
program to communicate with another 
by performing such functions as conver- 
sion, translation, consolidation, and/or 
integration.) ADROIT translates a data 
stream (voice, video, or alphanumerical 
data) from the center into Extensible 
Markup Language, effectuates a sub- 
scription process to determine who gets 
what data when, and presents the data to 
each user in real time. Thus, ADROIT is 
expected to enable distribution of oper- 
ations and to reduce the cost of opera- 
tions by reducing the number of persons 
required to be in the center. 


T his program was written by M ark FI odges 
and Layne Simmons of TenXsys, Inc. for 
Johnson Space Center. For further informa- 
tion, contact theJSC Innovative Partnerships 
Office at (281) 483-3809. 

In accordance with Public Law 96-517, 
the contractor has elected to retain title to 
this invention. Inquiries concerning rights 
for its commercial use should be addressed 
to: 

TenXsys, Inc. 

408 S. Eagle Road 

Suite201 

Eagle, ID 83616 

Refer to M SC-24152-1, volume and num- 
ber of this NASA Tech Briefs issuer and the 
page number. 


@ Reducing Surface C lutter in C loud Profiling Radar Data 

Radar data can be processed to study clouds closer to the surface. 

N A SA'sJdt Propulsion Laboratory, Pasadena, California 


An algorithm has been devised to re- 
duce ground clutter in the data prod- 
ucts of the CloudSat Cloud Profiling 
Radar (CPR), which is a nadir-looking 
radar instrument, in orbit around the 
Earth, that measures power backscat- 
tered bycloudsasafunction of distance 
from the instrument. Ground clutter 
contaminates the CPR data in the low- 
est 1 km of the atmospheric profile, 
heretofore making it impossible to use 


CPR data to satisfy the scientific interest 
in studying clouds and light rainfall at 
low altitude. 

The algorithm is based partly on the 
fact that the CloudSat orbit is such that 
the geodetic altitude of the CPR varies 
continuously over a range of approxi- 
mately 25 km. As the geodetic altitude 
changes, the radar timing parameters 
are changed at intervals defined by 
flight software in order to keep the tro- 


posphere inside a data-co I lection time 
window. However, within each interval, 
the surface of the Earth continuously 
"scansthrough” (that is, it moves across) 
a few range bins of the data time win- 
dow. For each radar profile, only few 
samples [one for every range-bin incre- 
ment (A r =240 m)] of the surface-clut- 
ter signature are available around the 
range bin in which the peak of surface 
return is observed, but samples in con- 
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